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WATERMARK ENCODER AND IttXODKR KNAB1.EB SOFTWARE 
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fH^*" ♦ v<M»t ») n ^ a " im't'nAhirt 

d J iereb> ited by sr* wencei 

10 Ira- eo ^ i - ^ > ■» ^ 

a t <. 1 ^< < \ < i v , V k' 1 ~« 'on 

09/563,664 emitted Connected Audio and Osher Media Objects filed May 2, 2000, 
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Technical Field 

20 ,> > v iMHh i i i io 

Background and Summary 

* 3 a ! ^ i f 3 , i ' 1 1 > i 3 3 > 

o \ t - v. i f dMed such dm 

25 da encoded code a mp< rceat; a <c nearls nmwKcpnble to the u ;er, yet ?uay be 
>ugh oma eleeb lost co ; > s 

w vss< \ is applied to media Sigaals such as anagew audio signals., and video 
signals. However, it may also be applied to other types of media objects, including 

UH U^U I 1 ! > S ' 1 

30 rapbK <x d ace Kaunas Mob 



? > -ft I <, ? ? moment 5 

e«co r&i embeds t! s s nedi is j , $ Chat detect 

<. v ^ x i o v i ' s a < ot ~i v 1 1 

i"a snspeca signs;). The encoder embeds a waasaooe'k by sUenna; She host media signal. 
5 The reading component amayeos a suspect signal to detect whether a watermark is 
present. Irs applications where the watermark encodes information, the reader extracts 
! mi rmatk 

h great ? eeo 1 -t ; an - « a la^mgj , ; mas „m known 5 he >e3de? ^ 
^ O X m i ? e * s I i 1 «. f s , 

emixdda ; i 4 a v i - v > < i - , s ae.m' i,k 

?reser t ass gi ee'g c< pend »g ar pi c 

a s n s s ea; aabi , x i ^ ( 

t ISM m m s vf -j and Braadaway ' k Dam (inventor Cooperman). 
f > \ -tt t \ ' < , _ j |j ( , < }C 

! ( s i Us i s K t < M 

i v i hoe, Audio'T'raek, Phftij 

H u N t s ^ Os > a o..mo % v. dm u 'i 

functions m software applications, devices and systems. Watermark encoders and 
decoders ^re arte* ran J a to opemt ^ > s i edn p aws md 

1 - > i i N 5 J i si ( 

the >^t v f k , w s , sk to? mm ^ k is leak > ,il )' m < u ' a, O m 

* K - i ! s t ' n v i i V iui 

^ j ! } ><.fmm v »c 

- v s. n < < v i s s n i <. j< e m s - j ens 

till v i i i < V l k <s s s ! s - k. *i v.. *J >o 

^rsphsdjen- as m so e- n 

On< q cmo me ^ m> \ ,s .taumumd 1 k -o > j s Ik: 

foVvs - s owse id ' ? i t s lu ; ? 
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exten$ion retrieves and d %p\ o s met tdata ot actions assoc ated wish the media object 
fi v ia th i c! 1 ntifies 

> < i s v v. hv. s v < v. ^ >\ 

V J J l K s i M U i 

5 <v I <. < i ! \ 5 Si I ^ * ,v 

I t ! > < ' ' 0 ' 

idetftMier may be encoded into a watermark embedded i« the media object 

A o s v,i i ! ! onx «- i m 

into alKfs mp t <. > a x i s i 

10 v ^> s j > > * t u i o v h ^ j \wdermatk 

fcni a s f i media sfoem eie md \ displaying metadata associated with the media 
• i]fje< i tik vi ;s >k v^emutk 

\ > ! o J >'k ii. reo>i v em v < \ ) s 

i i U v ! ! V ^ 1 iO s< 1 J - 1 f 

15 i dk x I ! i s ! ? sacked wit 

object identifier. The handler displays metadata linked via the object identifier m 
o n ^ ■ mpu 

*• ! ) i i v 'I'o.V^.tSi 

branding u < s v method decodes an object identifier from the media object, 

20 - 'K ■> i < ' o * < i i ; s > m 

ntsdatfte- 

Another asp tin men - i for ex ndm i er in ; > of a 
me lia ph y oh the method 

creams ;m object ujcatstki mm< :u ! <. • h uses the object identifier to look 

25 , V V t v. ! > * ! V <. s f <. 1 < H SuOll 

0 f i - O ^ ' s * s < s S 5 00 3 

object 

Further features of the invention wif.! become apparent with reference to the 
>l dctaiiec ptk ompa \yi\ gd > ?gs 
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Brief PescripUgnof Drawings 

Pig. ! is an example of user interface features enabled by integrating a 
watermark decoder in an operating system or other application program.. 

i , ' - i < > < KM « \pH 

metada h e browser < 

i t s i tires enabled bs S > 

rm 1 o<k so In! si 

r Si 4 sNvi <. s 

a media object via a watermark. 

' ^ > $ ! ! <W s e >^ \ ! 

v mark deco t tplayet 

Pig. 6 is an example of a user interlace features enabled by integrating a 
* - n trk eneod r is:* an >p d >g system >r other application progra ? 

Fig, 7 i s diagran < i $ > t that serves as an op< i rth g 

t for software n s r esafeled 

applications, 

s . I a s t ' . i . v. < < v. i 

Fig. 9 is diagram of the fields in a typical digital watermark. 

I O tO ! i > 

i mi I i ! is.i del < o 

I >g 12 1» a < ^ s SN\,vm v.s ( n 

watermark content filters. 

I id h ed watermark detector systes 



Detailed Description 

irstroductloe 

\ vutiiin e\ a \ K, .die..- m . n a t -uJ >^ ige v>i 

30 O n n j o o s t 5 v sens ' < > a > a- > 

media object wife metadata or processing actions encoded within or stored outside the 



-5- 

0 ioBjsct M I t t be encoded h < c s s d within i)K 

S v > < t * (.< ' ! v 1 ivk] 

oUb do P e e< l > > v s ii t <- r 

m<v v h < o •> < > c vH ) 

5 wiihin the media object. Wherever the media object travels, watermark decode?- 

vi K V" ! 1 V f t \ ' ■ d. f I 

access the metadata or actions associated * ah ih object via the watermark dak 

I ho , pet I * > > n v v d ^ t ) i 

roo'\ i]\P< t i \ 1 \a>n TLiii i vf cOM<\n 

iresMe k.a m«tadakje rate^e dv. , , ? ^< \v \ ! , ' o o s 

; { <i I s ?eh\orfc h* as < 

o sputb i i ike the . I met re u \ i 

> t 5 s-oi wrfhi m,< ooe o 

> s os URL hnk 4 ; to a 

q t ( Miter or device ("cliend'} derm 

executing some program or set of programs* etc. The watermark message refers to the 

iuxtlu- Is \, a ■■ , \<-i , . \ Hjs,!'; 

se folio -i v sns s I d vantage of this functu aid) 

j v ' operating system, totemet browser, and « applications (whether ?i i n u 

mhardw&s s < i software) 

integrating a Watermark Decoder in Operating Systems a«d Other 
Applications 

1 ! < pi Svcjte n 
0\ » ok,, < »a> ^ < <. > o< to 

operating system. The decoder enables the die browser to extract a watermark i 0 
vsriexc me r\ I i 2 user browses fil the 

watermark decoder may operate as a ferxjgrouud or background task, automatically or 
user-initiated, to detect a wateanaife. Finding a watermark, the browser annotates its 
ret reservation oi the media object as directed by the apphea; < ;aed » ifh i x 
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i t<> < f i sociated wi c ) < ewak irk and 

e Us t ? ! for example, the brows* 

. . l ! v ) i k< s 

5 £ i ii 4 ' > ! * i * . , 1 

with the actual i tti< rat \ 

J ! t. * tv. J ! 1 , t t trt f>) \ t 

! 1 Si ! I 1 Hi ! i s *■ O 

i <. < i * - I >t< '1i ^ ; vt \ . t . \ ! \ U,. Oi 

10 ! v m i . - Uh h - v ->c t it % 
process. 

AUcnutrwU the file browser can give the user the opportunity to control 

! > i i ) ion and pro i nark 

> * ii f ! ! t! < (.Hi »k 

15 ! 0 < * i * 1 h>»i 

trigger* * e <payk houk t N < t > 1 - j < 

l S Jl 1 * \ i 4 O i 

<. < to i i x k i.s .J via a 

h ! x i <. n < ! i «ma 

20 N f v i ; t v s i < d << o 

v ! us ^ x i , o i > 5 ^ a 1 1> l » 

rid!,' Vi k ! J * ^aOs.s • ,> X „ j. K 

user interface). 

! ? t o si's is t ;n 

25 f i rermatK link 

n t i I Js v. i I i X 0 j 10 

s. ^ t v s , 1 i o i , 5 \ t t > - For 

> u\ iie decode* (ot host 

ns,< t; «. n o s N k i Up, 'Then, v n 

30 the appropriate metadata server returns rceta< v u^-vd vidtbc 

1 )v x ! ^ ejtace presems - \ > i ) m v V oh ^ ■ 
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e server may ret p h as Java Applets, \ I > s < n 

XML or some other set of instructions, thai present information to the user and provide 
bn^to wiO s c > ! ic v \ lift m s 

! t or p j < , t lis > I t client eompi device 

executes it. The client topically is the computer or device that decoded die watermark 
I ( s % ! 5 1 v s l jy p fon a 

variety of functions, including controlling rendering of the watermarked media object 
a t \ i i i may ben t iked mr 

8 h ' \ \ i. Ov I i v ' m ( 

related media signals to be played along with the watermarked media object. In 
addition, die server may return code and/or links; to enable the user to establish a license 
rnd oh u i e - ! '•v , * it 

i e s v i i , 1 v i ^ 

v< KM ; ^ rs to be taken (h] 

providing URLs, w < viw, etc.). The client computer or device receiving snob a 
» a ' \ v ' in I is fUu' ». x 

^"utcjiiis, a'KlIo m A v ( vi ,r o a = < uv- c: the 

i t espotu c lands via a speech 

recognition engine, etc,). 

The use <. i ! 

< > <, I > v. N * 1 !!f \ < < IOC 

con rep eseu? d version oft ecti s image) 

determine whether metadata or actions are linked to the object, or to initiate a linked 
action or retnewd cf m-x metadata. 

! IK ■> <. i ! I i i 

i i i i t ! * i * „ < tv i I I hi On 

response to an event, at periodic Intervals, or m response to a user request. For 
! < < 5 5 semed as a iniltty servis sim Isj t i 

s that t ty invoke to a ex? j from a mod 

object hie, or Iron: a group it mux „ o rrk lie operating systen ) > 
desired to m\v ke the d<. coder at boot up on ail files oi a g ven ?vf\ n a ■• f 



ecotk I- i S S or watermark links in media 

I i < v k ! <cd to a s vhen th 

5 > ! < i^-v - kk MU Nv^tCRHiPs v ! 

5 fhodv eJes vd ^ - m , »U\ k-h . v i imV\ la 5 ,!". 1 !,,, a file, 

t I i< j < k <. do. .i^ c 5 < t ~ 

!hK I \ )k!l Ok ! > I v v. s < ^ ! v a 

which the operating system i executing, and whenever they are edited. 

To improve dm efficiency of the watermark decoder, the file system may 

10 Ut p v ! v ) v 1 t 1 ^ iklkMcti 

1 k Hit s « > i v! i 5 

i btVk'iul (. v i ! U m f H 

watermark « ,i! — 1 oh nnata check only media 

<> ! i i i ! i of s * v ( ioi 

.1 S which a given period of time has elapsed since she last check. Each time a media 
ksg that f he mark s 
to eoNUiV t mly < \ 1 eras an « <. k j 

C > >h) k m u v ii^kiMa, mm 

Syatciss F»g 1 jUuuL - 
20 inter uv kipp s con , ! cm s n-kJv, ohac. ts Mchaohie.t 

S s « e •>>' ■> - k . k 5 v. ' < \ >j c\u 

I n > o v s c Ov> J ' \ ■! h ^ , ' w <. r the 

file . m I GO, the * n access a context menu 104 em ^ m associated with the 
mkkted mm a-.ik/c ! 

25 , * : - : <. e 

! o \ n J s < o c < 1 ' i m v ! p ) j ,t m 

the cursor overt! Read Wales tern rvokes a 

stk u ( x f ht m~ I,vbh' h ) 
link' ami act* m con-: en vnb n mm! omrmm aeon so:ec m to access the metadata 
30 dauhase and ten ck th<„ okce* hoso the eatable cssomand ^ .th tv vmt.uma*. link. 
The file browser displays these items in a window 106, 
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There are a variety of ways to access fee metadata database. The metadata may 
! n < v > > s x or a 

wide area network. If the database is located on a remote composer on a computer 
network, such as the Loteroeh network cornoionicstion software reay be used to 
f> establish . connection with the database. 

\\ fx n s 1 1 <. Ce "\\ it. nr 5 \ op{<< > * 
v ! c\h ! i o m < o > u. 

v> it v.o^ U \.J hn e lis s. n s I \ o w as t o * o> >, s b 

an image via a « atemiati; Us k embedded 

h , > < s i ! > ^ % j t tw 

p. p\ i I M \s t v i o i o i it v us 

(such as a search for related images at larks I hh i 16}. 

moth > v <. i ; n r 

* >t v roi« <> v i ' a 

accesses properties < m * 1 1 8 it Fig. 1} by right clicking the mouse while positioning 
the cursor over die media object's icon, In response So selecting properties, toe 

hspla m>pt \ e one sho\ Fig. 2. E&el 

^* t v vo t o x t in hi( 

X> - i v i A i \ ^ \ ll'l 'HH> s 

dcspbgmd m. the e mdo^ b><- o\ \ t v t o ei;^ soffit Ml 

links 202-210 to additional" information or actions. When selected, the link invokes m 
Internet browser to retrieve information at die underlying URL. For actions like 
searches dt* ! - s » \ h • t v > - < - ! ul > m < t< 

media object to the scree? nt the URL, which m tarn, executes a search using those 
parameters and returns the owes to the internet browser. 

V i . s o \ ' < <. I » < t v .v. . n, 

! V ill ' 1 > \ j <> i ! i 

no w; - e m f oca-. o> A m> k if 

w the siopUme; nation may , the examples depicted in bigs. 1 and 2 are 
she 1 oioK o ts of mo vL < <. s, U r ■ •> d 

a COM object cheat of the Windows Explorer. The COM object ohem is registered 
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with the operating system as a shell extension handier. Fig, 1 depicts a context menu 
andler, while Pi ! ! ' o ■> 

V t - ^ 1 \ , ! s ■> ^ s > i* i 

shell v m >. ! i ' oi uo * s 

»nit i ■-, mi e <■- \ v > t <. <. i t Y-, ^ ;b: > v s a mcdm sh omu 

s ! \ v it . ! ^ v \ ' v < > ^ 0 tO 

it' ' V v. ' «. Uihj'v A 

numb ctions ca 1 to this option. One a \ i ' l 

?er,iC%a!apr f i 1 o s v i is^, hih 

selected option Ouo. > > o < t \ <. * v v cot o.u\ » 
operating system. 

One example of a metadata retrieval application i i waicrmarf decode? that 

! t ! - it > •, v J 1, s , i( fO 

i ! i) lu ^ On i\ mtum-, metadata. As- noted dv\ a 1 , i , , ki u 
need not extract the object identifier from a watermark if it was already extracted and 
. o v v it' 1 ; >roceed k 

display the metadata and actions to the user, 

To launch the retrieval application, the shell execute command passes the name 
ane locates ! > < 

preseia i t t \ s 1 <. s odea ,md aU m ; :! ,o pass 

them to the file browser, which then displays them within an extension such as a 
S > V1 \0 n < o o\ 1 ! i ! Ml s ) <' 1 s< ' oo,, t h, 

use v > 'i - oJ..,\ iu^v ess o < w ! s m 1o<,oS 

metadata tr s 1 i %<. < s > < i 

one or more other applications, such as an Internet browser to issue a request for 
metadata from a Web server and display metadata and actions in an HI ML document 
returned from the server 

The approaches described above can be n oa me c , : ''v a sanely of media 
oo - at i, , v v.uOme aoc^, \ dec ted cad < o M; - tin o < o 1 cofses u\d nm 
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he inserted in a watermark, but instead may be placed somewhere else in the media 

Obj'-Vf v > 

]n B-\ ac< 

5 h <. d u s a s< " ^»n. ■> o*>< v! 

K j ,! 1 ! * i * ! N s s i f i 

u. local eomp * ^ e s .'.a-. • ^ ! h ! In ^atl^^hi.^N s ,i muti 

f l - O i N J <. £| I \< n v N >v Is 

1 > O i\ * ! i 1 !, i s ^ 

10 <. ^ <. I * \ \ ! ' ^ > 1 > > sv.< - - v. , i V >S 

\ si; ! Basic ntenx ns \ * s s i r HTM 

for dispig) kt a < jputer « ther dt ce's user i Efface, 

Todlasn . ; > ooevfm luteaxi hn>v. s <. dv 

I e> S © j us 5 ' ^ v with 

1 5 media objects on the I « 1 i id cheeks them for ths 

p > * rk ! « s e representation of the objects 

^JiVui - t v i > u \ , alls HK-i.L^ 

f ! ! > ! i I S f >\ 

- S < <p'-\\U>-HJ V\ ;ohOv\ < V ' 1 ' < >\ <1 

20 upKSsm su^mf the media objects. Fos images, one way to represent she media object 
is through t e ! > eet< maj be 

represented as a graphical icon, texs.ua! description, or both. 

! N s hs i i <: . st ! 1 < srs h a i f ' < 1 

U st s x < v < »> ! * i it 

25 ,i 1 s i if 0 i i U HT,. 

fashion. For example, the user can ciiek on the thumbnail, icon, logo, or textual 

< K> acces - v i i < > the objcs via the 

watermark. 

\tmtru-t v,(S i< \ a >. v. $ ! u\ ? > r.vcet^ 

30 cursor u\ s ,T*mh;ca! ts i nterface of the software application when -he user passes the 
cursor over « d d object or a ^presentation of the object displayed in the 
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X> f 0 ! N U ss is fl KvUlf 1 U 

type. Another way is to animate the cursor such that it morphs into some other shape or 

l *. i i s s i t K t > f v. 

appearance of the watermarked ofnect as hie user passes the cursor over it., h; addition, 
the user interface can produce a d<shnchve sound when the user passes the cursor over 
the object to signify that it includes a watermark. 

* n-' s *FT <■ x ! u " > 1 ^ <> ttoot. eh oee 
is, k-nu uk- i ; ^ \ ! ' jVivSiAM^oek n oeo 

i ! IN < ^ s ! ! , v >. ' s r. 

i > s r^eiO .turn applu > <. >nv, o * . <.h 

< < ie > < wt i | - i sent un ors « t 

i ncountersd web pages internet or eisewhe? k 

5 i ! ! <v nte* " Usi Auethe 

application window may be used to display thumbnails of the images > this bookmark 
list. ' ting an s s he Pnw ^ vh > \ 

resource associated with the selected image (eg,, via an associated URL). This 

vork i eraa [ 1 image o 1. Alternatively, th< 

resource » - 1 x t ercoced via the e? k m bedded in th< > 

\ O ! I . v. » 5 v. * l 1 f kid 

p ! vw i , s'-- ) > , ^ the 1 Rl nupht link 

-> l\ OV " W ' >v 

1 \ Is described in US Pa eppbeah Jo 0 { ^ 1 N ma> be 

other met 1 ! c : 11 s s 1 

One wa% -o ^ ' s i * 1 s w hrked sO s- media 

' s< s <. v c s c s x i m in < < k ! i 

Fw Up n w oj ; Us s v 4 <J n u 1 a > t\d 

1*1)1 .( 1 ! . s ! 5 > s b i> 

s < s > - V 1 1 < S i Ui ! 5 <> >i 

has been downloaded. The listener requests fiora the browser the address or addresses 
of media objects in the web page. The address indicates where the media object resides 
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Iffl 'f «1! ^ i . r s ^ Vv 

xvaterm.ark decoder on the media object or objects, passing it the address of ids object 
in. memory. 

n dt a watermark, the listener inserts a handler ptogram. into the web page in 

\> i i 1 > kO ! if O I 

to the user indicat > presenct vstes od providing hot nks to 

i < i S > i 5 f v is \ s : > < , V t ! 

superimposed over a rendered version 30« of a watermarked image object ;o the 
browser's user interface. 

1 <: i ! < u s m vi !>s 1 lerprogran 

i M if, ) S v I 

ii> f xt s f - f s n > < , ?kt id, s r\u fx 

t local ernot e i v i , s bjeci t > w watermark to 

the server, and receiving associated items trorn the server. These items may include 

( Rl imU + OWvd < 

o i t x i ^ <. i s i x 

i . v s > tepk 1 s. 3 a»d 4 

- 1 , < O ^ I ! \ . i I . ( S O! f ^ > ,'<»'0 

M.aosotK , x f ' f s „ a x hn~ ti^os 

u iUjh I ? » ■> j j i x t f I s 'an 

x i!s b x {fx , c t h !| 1 i >Oi o n 

and respond? <. 

) S V p S I N s 1 J , < O 

' s s i ! i < o n " n mV! fuft n 

to n 3i^j,( ! < si o . i { a s 

; a container o media object (e HTM ! de a control ps. seter (like a 

d a tf si > 1 s ; ' 5 i ' 

enabled media object and whether th ^ d disabled Fhe 

nurd { v v i f i i i v x > i 

oft', or vice fs -\ eneono developers n \ ran imes 

worl i a o^ e, t > et opt > disabk the \* * luvk t th nm 



parameter. Editing uxds and other jp'^fo- programs ami devices can. be designed to 
am the flag on unless ex\ I ? s t i 

! i ; > f is i i i a y-.ai.c-rm s (ik 

associated metadati \ 'n ^ oifh ys s , 

5 ^ t i <. ^ m> o gets modified, etc., t may lose convent ional metadata stored n the 
s> e oo i k i i <. c n , - a , < t „ 

metadata because the watermark o rebus; to various forms of transformations (e.g., 
t I \l i ! v h i ! v. compres etc.) 

\n 1 1 v > <. o x the 

1.0 emtark \ * < on < < 

objects. 

The watermark cm also be used as an attribute to the browser's file cache 
* cache browser appiicat > h d 

i > <> 1 o in-kluliotfe 

IS o v v v l < , ^ -a a . . ; ! ■> > u 

in Other Ap plications 

S s b < > > i I i t < d > „v o 

I \S > ^ J t l<l ! ' ><-U U 

20 ^ ' i < ^ Kiionahty Digitat as^st msmaee* . t I 

rights man a ^ * > ' ■, < < > - > 

ose m aavoa vac- o 

Other appocv i < i i 

m > s d < * ^ v la i ' k < I ose &ock 

•25 ^\X- a ^ "* ie ~a t e s a 1 1 h v t i I I audii sation 

and actions. 

M,m\ a < 
using, the technology described as das document. For example, the file Open 
^ u I s \ I to * N I o > ' 

30 extern-bens «haa:nbcd above ran be tmplememed ibf appheaoons tlaU ptovtde file 
browsing sendees. 



v r ak <. 1 d -kx , i v< „ k<> he in i no f?k 
b ~ i, ^ r ^- n r v . . . . ! unntj'* 

! n I s I ! ; casing software axecon 

numbet of client computers interconnected on s computer network This software 
S tuuhs the ^ < * s f -■ s r t i s h u k 

! ! ■> ' o. i \ ! 1 I v. k ! S t 

* r \\ or other Ibrros of embedded data in tiles to control file transfers (uploading 
and fto\\n s oo< x \a Mo ^ ,\ -> > <*^?J n^t, ^ v ■, no o v, of 

viruses, carr> a ada ; l i ?na\ bs - sod to s arch for fin s in th Ik shari n s) stem 
10 carry links to additional information and OpportMhies to obtain usage rights or to bay 

111 |U U »p! (1 1 ! 1 ' i i N •> ( V s n 

tnnoO<n t\ ok ha - <>->ib\, v ? .\e-vonei rx o <a c an.KdOeddo.t 
decoding software. To insert or alter this funcnonainy, the tile sharing software 
< ! * i t ! < < x al on 

1 5 on this application, see US Patent Application No, 09/620,019, Sled July 20, 2000, and 
died! x S i i - \ f > i > i a 

above, 

CmtLv! -3 Links 

20 t i > <. e ) x < ( ■> 

context sensdive. Some examples of"' context" inciade application context (e.g., 

! t << -n *» a. on ha ^bjc-UM' t i i n 

' <. \, v o ^n < ! * < < t <. tl 

link roa^ a < \ h) ■ - > s s 

25 ^ < *s\.* Jos vu.r;, < 

> i i n n i Si- j s 

nvJ n w ' I \ , h n v < > < i a <. n I 

nser, 

I ht? tku dc~ < i ^m i e^too\ 

30 > ! m< v > Ol > t * Oi I V* I d ? J v U ^ ! 

watcrma noxxkae \ si* which in 
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H 1 J , 5 s < O s "\ * i s < i\!t\ , 

i be objCCt i < ii i kv 

i 5 > \ U vv. v. < s s L v^P vri 0 

i < s the ok os est uifoimation m ! 

where the object redoes relative to the user's computer. Using fo context ){» m <a 
kko be-s\<e J *w v - < i <i n ^- s v st i 
associated with the context. 

! I v. 1 s t ! ' v •> ^ 

t j <. mtro i s f 

\i S i < >S * 1 v v i O 1 1 < i 

this ippi ich ss ion access to netadatao* 

actions, and then letting tU upplu at Re? eons \ > 

in o ) e << t v t v r o v. > 1 < ms at least a 

descriptor of linked information and actions, and tfcs application chooses which sub-set 
of the information or actions to apply biased on the context. In the case where the 
context is defined by the location of the object, the decoder operates t t similar 
fashion. For example, it may choose a sab-set of the linked actions of reformation 
based on the \\ e foe object. 

Ai>pecifn.o \ ' t > 

OSOf ^V0)1^K^ ' i ^ s ' <. •■ I < 

o. o m , < i i ^ v e n n i i ' <, s 

M< \C v s o ; 5 <.\ ! h > ! > i . >< ,0 i 

cookie ine\\ < . s . v <> > een>-.aU> referred to 

\ oc!k so v t so i t e n s Oiv,< f >, ', \< ' ( 

s ion extracted tk $ ta n b * s > nformatfonoi 

t ! I v.s Kt i 1 * 1 f i 

web pages} in a database that relate t< >fon tin n tl cookie Fhe server further 

k- 'w ,.s 5g the Vv.ntri n el ■ look 

ao a subset ot t i or links that are pes ? s hect 1 ui 

either the server, or another network tesoaree referenced by the database operations 



-17- 

returns associated rh <. for rendering on the display 

tp x d > sis pp? !! ition reiurn o 

specific news, advertising, content, etc. that is Hkely to be of interest to the user, A 
i tiv ! x Rster to supply us 

5 ,Miru <. u w w i ! < ^ K< i 

Supporting Multiple Wate rmar k Types 

V \W« f 5 v. < » K v u\> 

of watermarks, each associated with a <. * of watermark encoders and decoders. To 
0 accomwodate <kfekrent watermark types, n decoder can be designed te support 

" ^ ■> v \ f" t o > , it W «^)!Oi. Kl 

Twnmtu ^ odcod^N n ^i/ihi ,i 

uoiiA] rograrmwng Interface (API) t r Feret COts 

m t v. - U ' < v k< K <- Itvioes Liul u< 

5 i ■- ii tt o ! x i n suxt 

watermark encoder and decoder functions, yet are independent of the watermark 
protocol ask < <. w.ste -nethods, 

s 4 } v d i 0 u i ! i no o no < 

Oi U V v i > ! i I I 

0 < ^ Wa 1 M Ik , ' !.li> O "AMI'^l.'l ) W 1 

the e ' i f process us a registry, seek as the registry in the Windows 

iAp , \ sk ■} j > j j 

v \ \ o < s t ' s. s ! < ! i > 

w ! n p V 

5 c s ^ v ! vt v. x s o j j w Ik ndi ' 

mm o no v ! wwn n - ; ww : jcf i t i ? < w s 

< ^ v I <„ Ov t £ r < i t eU the. 

appropriate decoder by extracting The type parameter frcen the media object and 5 a - ee 
mk 3 v i * < i > n i >bn 0 v r * inxitslc via the AP fh k s> i r >ut« > 
0 the request to the appropriate cote module, which in turn, extracts the watermark 
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message, and. returns it to the API 'The API passes the message to the requesting 
application, 

\ k s 5 i s >r Jevfct 

h I 1 <. > s < i iv. < \ ( ^ o - to 

n < v V < s v < * < ! 05 i 5 

system). > cheek for each one, the application invokes a watermark screening process 
' ; .1 ~~r -^^ o - -MniiTic whether a v ^ \m - , ^ ^ ! ^ 

present 

.10 

The. watermark cat* be uset to establish I > taciHtatin 

x ak i <. } ipplu > 1 \ 

decoder enabled application or device in a client reads the embedded watermark 
3 5 k -i < i > d < 1 < 1 if > 

(eg a brand "brand image'"}. The decoder -enabled application sends an object 
identifier taken from the watermark message to a server (such as a metadata server on 
f ) dication the > ; enders the 

\ pteo. ; nis t v r , > < s n n hie ai 

20 ropresenta • ' « device 

s some scenarios, dm server also retnrm an address (e.g., UEL) pointing to 

i i S . i 1 } i i 1 P s 

i i > e v * return oae or more rd << el i d 

N ^ >. s t U. |i*i mdi > 

25 , itenK 

tismg .0' i Us o v v \ v! «. , t on „okd 

x i ons have many opii he bras s t tsss An 

\ ! i P N > < i V 1 I , f ! f 

! > "i 1 ' ^l"oo h >u«.H\ 
30 superimposed over a portion of the rendered object (e.g. } in a corner of a video frame, 
periodically for a predetermined period of time) or displayed as a splash screen 
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is! ? i i I ! . ^ _ 1 5 ^ < ' U > » 

i > < i V\ \ W K <|0 \> , > ^ v fC 

m v. r 1 - oou f < 1 v i I I r iemf) 

The branding service transforms the notion of copyright mn<Kan m into a 
5 t >ra I w i o >nali?y, &ucs as a 

> link 10 the home page of the corner;? owner or to a licensing server. The branding 

(rt SKt O 5 f J ) W 

ro.eko-r me o bv-irnw.mn in the watermark payload, e.g., a control parameter indicating 
whether 5 object, may he played., copied mtnnber of eop;es allowed}, recorded, 
10 tmtw<- i I I j ; s ..m i to 

control i sat wtn ! > <, &um« {e g , 

U ! ' < ! i! I s Os v S •> ,,„!!, 

ensures that the .media object is well labeled and branded during playback. 

W v. i <. ^ 5 k\ ! s v. v N t 1 ).\V- 

IS lift S v. ! \ I ! W 

ta<1 a - ! ps . ■gsa w 1 * s em.res 1 hose 

te ttctcs > i i o t nor 

and/or metadata to ho executed or returned in response to receiving dm media object 

v ! i \v \) I f !Ks i , 1 hi 

20 -n i m Os or arm. ^% m th a pKw .oc < - t ! 

v er.fi tier. 

Aggregating Metadata 

is \ ' ! 1 V V < I <. * i t <. V > ■( 1 i < <> 0 > 

25 ! - < s M C ! O > < d H s e h t < 1 ! i » t 

obje t For xtane file formats like * f ^Us io* 

i ! \ two Hi tuJ 

instructions associated with a media object may be stored in the same device as the 
o r n r vvs. < , . < i < - id- s \\<>i 

30 ippli < tone, decodes a • a If pmc a , d he 

different sourcs fh< ediatvpe fxk x na signal to the decoder to i rac 
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! < I It I v ll i i d 1 ~ ^ ! ! V M , 

mc H v <. tC v v > s 1 ; * 

I ! v *. cd to m it <. eVa ♦rm ; t a 

C O V > s «. ? rt 1 i>. ( ! 

s 1 s t t - hspiax 



highlighted below: 



Metadata casi be expressed ;n maoy terms and provide additional , i h>>mhtv 

i < i S , h ! ^ h 1 ! 

■machine instructions to be executed, or a reference to ioforrnahon or instructions 
object, user, p n I R a t udices o 

K ' 1 v. ' < i s \ 1 „ \ v \U T » 1? K 

Hoi" j i\ may provide some ancillary s i mm m - 

One t p ^ application of metadata is to provide ownership i > n i i \ 
\ o ! i is to provide licensing terms and asage rights. 

The metadata can be used to describe attributes of the media object that the user 
i J > m < 1 <! i l i v t i 

s i. v ! v. 1 i ! ! tktl a 

5 ^ k v.* i UK pa 

v> t i ^ v t , , i ' * S t i 

" d , ( v > > 1 

U t P C <- I t i \ % i^i 

each associated with a distinct set of information or actions. For example, the media 
o v n a\ v a ? ■> <. „ 1 N , > 1 4 t i - > > < 

creator and distributor, respectively. 
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ea n > v %\ atc-s v i 1 px v < 

bier tion * ! < J ! > , ^ >pa ed.tr ) ! < < i 

to mtekeave separate v^itermaria; in oi fferent portions of Jv -a. .s object This can be 

! > < i i * ( V f * <. i < vp^v. 

5 kv\ m •> s i w s s \ f vi ^ K\\;>, kfi ^' 

othes watermarks Whin two independent watermarks ma> idles the same discrete 

san r it of >. ruxit.. oh\ mm ^so i < f s * ^ f 

any of the watermarks. 

i i I ^ a . - m^ k ocate< < . t , <s temporal 

10 U!l 1 i < <<-, ,k< 5 ^ ! 5 > pi i! i 

Theo\rwl < \ ! ^ * v. - * < ^ > \ thw n j 

K J ! ! ) i l v. k * W S ix 1 

trc >% '» i 

i i I t i ^ ! v i hri 

15 < ; i rem. p is ( t > 

encode a > Pv v r \ « < menage map, different watenuark links for a creator, 
distributor, user, etc. of the media object). Independent spatial watermarks may be 

v. ' 1 v. v ^ \ \ > > UA.t.O!) !! 

t, s. :aa . 

20 > I < ? i ^ ! > t [wi ui u 

\ v v u u < * \ > i mpou' 

locations. 



The watermark may be baked to mmrmanon and processing aekons that, control 
use of ike media object. For example, the metadata may indicate the owner of the 
juJ! v < > ! > v. 1 < i„m i n 

Further th< watermatt link or moon; ua mgges processing a< horn f kat co strol use ol 

-ik <. I v K ! i 5 i i k I I 

ur^^p L i«pt 1 k n warn .'\\:\ki < rse bp \ 



m \ bi, 1 So extract the watermark : the remainder of the content may remain 

c < v no, : en uo\ >,) 1 , ^ » ^ c s s os m > - v „ ! * 

Th* d gital rights management tuTietionahty i,an be impk m 
\ n l \ 1 ^ ! i! f - desnv^ 

5 ! s < s S v s Sv ! V V V S ! 1 J 

h i* * v< ' s t. s I ! V f * s ! 

J i v i i v. v. ! S 

• < < ! , _? A s the user p\<t\$ or renders 

ffo neduu ct the wa rk d dert s message to ie server u og 

10 urns o s o N u v si v s u n > sv. in of 

uss f etc. 

<■ " " ^ ~ "J 1 " 1 1 l< d. l m , > ^ 

Watermark ot cai sou nies info tiers it formation 

M » t s <. <. i\ * hiUh^' 

15 I i t x i k i dering, 

editing, copying or transfer of a media, object depending on control data in the 

lv Ml > % i" i - vis hi \ 1\ i 

Is sides. For * f v i not il od« j sihit 

! V 5 < > >v<. d ub v < 

20 computer astern, computes net wm I s 

1 1 ^ ! W v s ^ < v s x i < < < 1 !i < I \ S 

o ? i > v , 5 * o i < ! t 

the p enccofa $< lenti t compuu idc Li ci fU identifier, storage media 
fo-nifoeo so opov? idem: for, network ides Odes etc Kid: enarmm ffo epet dom 
25 fot^e ventiiier- ,'\^-\!r,>i-^\e \ ^ , or r . 

i > s f i s s n < . j i <, n i s ' 

a i h 1 vaue i i * * i f i ) 

can be stored on foe storage device, or derived from content on foe storage device or 
some attribute of it 

30 This context aeostoc eenm ' > \ u-vifo % 

o< 1 e ing the use of media files like music and movies, but applies to other s it 
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i <. S s 1 <. i t 1 v. > I ? < u n! \ 

sensitive <> i can be used to prohibit rendering, copying or transfer of a media 

K < K t * ed fro > A >f :mveh page- aeo or sto t levies 

(e,g.. s a CD ) x in c , etwork, con ' > sum ers of a 
5 n i < <. 1 s 5 



The veer. ;r <. k embedded in a media object n\ . o; e i roi h asset 

>0 ! ' ! it ! f v i (. [ i { v V V V* > i ! 

1 0 application equipped with a decoder can log mfonnatmu about the processing event. 

Alternatively, it can send a transaction event to a monitoring server via the Internet. 

The transaction event may specify mmonation about the object, such as its ID, the 

user's ID,., the time and location of use, the nature of the use (number of playbacks). 

The tnomto !<„ < w j ! < , t s i !> s^h^e and 

5 5 tpm request, gc s rep so t v< ven entstj 

\ o oft.be eld oi he t s saeti j recoj i can >e u d to $ ethedat base and 

generate custom reports. 



ne ^ ^ ^ „u m o, x < 

20 Dn^ > ' <> t ^ ^ V « i 

. !v v i ! , u j \ ( 

. 3< ^ n o i H ' u ) K ! < < ' t v. > 

> \ s i lemovc 

bor evunpk' o, , - .,i I ^ - »u , :vi U „\ so m 

25 o sk \ i \ h v. > <. t v. , > < v. > v s t . 

> t in hi s 

watermark d« i > ri metadata server as 

jredetcro iaitkm \.u LDAP search t ciu * < vatermark 

iKuv 1 <. n o b > x 1 ! d i v in 
30 directories on computers. 
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M edia .Object Raver and n_aO^D^JGlM!llLOQ 

A v\<u \ ; Li m \ \ ones aed \stih so to «e aul dtw < es fo oS 

i > as mm 

^ i \ to < k i N i 1 ! " ) Si - v ^ <> 

■5 metadata and actions ihiked i& the media object to be accessible to the user in & 

seamless fashion through: the user interface of foe player. Lor example, when a user i$ 
playing a o;deo or audio Ids, a waiem-ark enabled player may access and display 
hnUd r <ta< t ^ < n s v ii i s t k 

user need not be a* hat metadata or actions at server vi 

> 5 ! e \ ^ sto j 5 a eof s o lud toe, 

< • < i i > t x ! >T vt 0> > s i <■ >, c W v i 

wherever tl j >u ion arm ca implemented b> 

; a ommawafermats % i ^ - ^ > 1 >> v. 

r ju tbe vvateanark tbaf ks i t or action uf »d< c 1 >je< s 
detailed throughout this docmrmnt 

1 s. i >" > v i ! ! ! ^ s t ! 

> . inn a ! >s < < i vi\ n,oa 

J ^ ecu toto.d ■ sa to*, a ew-oo to, >r a n aas ■; 'bat appears to be a natural 
<.\ si to is s < f I ndm 

- nv jys ilk >r nchons pro \ i \\ } is * i 

K V i v V S U i > I 

These metad rta m . < < > 1 s » d 

<onux «. ie i.e.e,, aa a Uaekyr > i c 1 1 a < to 

^ s i v <. < i i 1 si' i > to .Ik 

scenario tin k i <. ^ spots «>a 

sc ' v. ! i te !v«npl N < s, k < <, s 

of the object to the \* iterroark de orb which u torn m mpt t< dec«x iwati nark 
embedded in it Upon locating a watermark, the decoder forwards an object identifier 
> > « om it ima v Inch returns metada r acti s * > \ I 
with the object Uiehlifier. During metadata retrieval, the media player proceeds to play 
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(k media v \ v ! is a e v f ! . - i <. f u.dn obnu 
i •> os et ear.; 

\ 1 ! >t ! s cat i hi! cro s "> \^v'" i j 

v h i \ , iikfk 

5 wiiiMOi, r v. s ! i v 

< < v i i ^ s ! 'I v s ! i ■. s V! !?s 

* <!J N I * | M . I . > . . N - ^ d O < .s N - > ^ v 

'hat item. B> U > ; > -.ai > ol ? w > pi r-cr i -. \^ an knome! > % 
ok m the iftrtiiio in the vd-cied I Ri < c g t quest aaHTH'w ness 

to download an H 1 Ml document). 

rhewak ^ c < 

I « V IS ' N i. I V 1 . < H < ! 

1 1 «<. i i i-sj U s 

?>h tl ( ects object fo jyhack Foro mpk. the \ emdd select a 

Pla> i ^ >:p i u 

neat as exp * I shell exi invokes the 

v> ter I t ! < \s v > i OM 

object, script, etc.) that runs the media player i displays the additional metadata 

linked via a > >> > T \ I the second ease, a Java senpt or other ef i.n the HTML 

\ v v N * ' i ^ ! I I x ' > ! 

similar fashion. 

Ox. I , |?v i OJ ! ! O j ) ? ■>< s >t 

through th*.- a ^ <. i > ^ - \ ! < da. k\ sn.knto .? 

s \1 links m 

! v > 4 i s v ' > > i si a W v 

1^ j c U > ' ^'o >>! v> \ h T vM tosol n 

ip Network 
d; 

Media content authoring tools, - eh 0;: e web page design tools, may include 
aanerma shry to embed rkt inu t mtej i such <> we 



x > v ^ ! ! ! v< cm \ raoled dt.-\ < « ! 

sofware to perform functions o<. 1 with ihe embedded watermark data. 

s ois may a I " t 5 s I e u 

[ I % C ! v v 1 Ci tor 

5 cvatan t i > v . , ( x - ' ' v hm m^-a 

ditt.0v.Osv ! ) i .1 I i ' 

ft t v 1 t v ' N ! K ! i 

% i to s i n s , <n centre! the 

use of the media object based on that information. For example, the watermark in a 
10 r «. s \o a - vir a xsTi j < j >> t v ht ' h 

mod ivf <. u? K 

Web Server Integrati on and -Related A inHiCatk8fc.. 

W iterroark encoding « d< od p functio s may also be integrated nto 
ti s i ! v s 1 ; !< 1 ' ! ! ' ^ * 

15 as well additional functionality, in particular, watermark encoding and decoding can be 

« ~ i V X i \ ^ 0< S 

Watermark encoders can be integrated into web servers to embed watermarks in 
; <.i $ ! -i ' i > X 

watermarks at the server is to encode transaction specific imbrmauon into a media 

20 0 N s t ' * > i • v i »vi iort-jHu 11 

> i r i 0 xv < < i s < % ' 1 h 

v x * v p v v v > > > 'v ■> o t , n , 5 < s f ! 

server may embed information about site reeipsemfoemier of the tile into the media 
m- m t \ ice m ■ ., =n;.c.-e, ji. !i <- or ■. -oe-< \io< Sm.e the watermark remains in the 

25 s remains with the n edia 

Met a; r the v v o.Mi < n o ■ > _ * a u>r«' u >m * < ■ nm,e 

changes, etc, 

Tsesc^e- en\ c:,fo < - m < > < ; . s v N n t inks to routed v\ oh 

sites) in the file that is uniquely tailored to the sender's/recipient 's preferences. The 
30 na-Vrencos mm he 0 > .mod f;em ) >„? a computer, such a,\ f < ^ ; ooel tr 

\ ». -si tsised m trterr<. 1 t v t ti 



I < > > ! V \ 1 v v. <, > < * , V . - CO 

nth the i referen pi u % 5 

i < ! >i ; ) M i y ' 1 ' s ! 1 ^ > t ser oh-tmes th> 
i sjt-x -acne* x 1 < ^ 

§ rise server mas dso use Uic preference hwiaed in th? a imkt to control what 

;ottm i 1 ' N k * u r i s mav 

if 10 u ^ ! > v . 5 v > V >J 

S<. t V t IS Si \ ! ^ v 

si O US 1 „ 1 - S vl'o 

10 sJ- Hi- ,\ MtO v \ si. *K 0 '\ 00 ^C'o lun.stkthn 

S! i \ i V. , 1 - v. ' 1 x ? 

i s f K m i i «, >b ?ites, ere liv &u \ 
computer receiving the file downloaded from the server thee renders the .file and other 

t.^vuiv^ ! i if n^ ^ i ,e \\» is^ii\oUi.r 

15: cor^ t c\ < » otHhv*- ^ -*n v t » t >. <. « J sm 
watermark m the file. 

jv.se? - o 1 i. s i j % s un I 

kio ! td * > t <. s ? i N i n 

v s i <. 1 s ! i t oS 

20 b> other applk *t < 1 » 

' > V OS. d 

s vi v v i ' ! M U\ 

so ^ > ^ s si < U < i H< 

s i s s i O i i V i x ! S 

25 d (. ok v ■> i s < i i 1 s ! ! > < ' 

,d> c \ o - Jk^ 1 wi t v s •> dn t si o<n < $n 

i v S ! v i 1 s , ^ t ^ 5 I i i iU 

rating motshtkii (adult eoeteot indicators),, copy or transfer eontrei )i™ or 
1 <. mti >1 i formation, coraprcj ss t 

30 ks k e lern; s s i 0; > etc 
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After extracting this data from the watermark, the server can modify the file 
< i > < n k w ui i e <. < p on 

its a manner specified rn she watermark before transferring the file. The user at the 
ur nutAciV!,' U < ! v. \ t 

5 f t ^ <. v t k i w ^ t s 

In adkh > s « ' o i * i i b \, i ^ u 

Hi >i* t * x < *. n i , s v > ^ in n 

■> i s > ^ > s H' 1 m ^ » he u\ t 

determined from the watermark A < the content was marked as v, aduit content", then it 
> «. idit '! ■! >~ J 'Mi ? dw f k ^ , > ; O' hesder > d i i 

the browser, how to r< de t < n nia ont at f h j cde «j software on the 

ree-sh ing compute? t ! I 

rpu s. \ < sU s\k i on n .t 
to render cement in the file marked as kwhnt content." Ac another example, the server 

n 3 <k <xk %\\ on \ew to 

} \ j\ iij varetoenal < Hi (press the 

< 5 iir \ lo . J e 1 ' I viv , 
i S 15 w t s < < i > 

n that instructs it to send additional data along with the watermarked f 1 
i t - i >!.! a o , i- k\ -ewv w t , < 

watennark. 

Content Filtering and Counting 

Watermark dr c * he us i > pu d< spu rks to filtet 

watermark e so on t ons-ca 

v v 3 (H ' <. ? s O 

I c la c, transfer or rendering in 

espome to control da prios esj \ ' i 

< dexul taout uit be watermark ese me objer ryb iorari s \ 
> er, as t J t .Oi ' s >o ! errh 

the media object. Examples of seek systems are e-mail servers, firewalls, routers, or 



' i \ ! v i * > v * out 

w < \ ! O 1 { <.-, M O >»U VSs N * 0 > N v 

! i ( 5 I i s rtl ik » » anot I tut i 

> > M s s i i ^ O vi v > k < u K eek 

5 thai a user downloads to or uploads from a mass storage device sued as a hard drive or 
I i > ' i , asdmovi*. files * >. 

- s < t < i « ? vt\ v < o c or upioat 

i!Wt>m,s x < <- , * mi <>> tua i f ' oaamuarem-d,. or 

altexmrtively, may be used to control rendering of the file. 
1 0 Object coaming refers to a way of togging the number of times a watermark 

i e> u < v s. , ' ^ i ii? \wt tftuusgh < 

particular device or system like a drew ad or e- road gateway, or by aebveiy scare hi ug a 

1 i ^ t\ s' 1 ! s v ) O 's 

1 » U <. ! i i i t u * auk 

15 decoding systems can be adapted to include additional mformadon about the object, 
including information from the watermark, such as an owner, user or transaction 

n> s found, 

! i ! < ! > ^ v O, 0 ! 

-oriv ; J r the die in response io some event, such as detecting unauthorized use, 
20 v 5 s < > * ! * ! 

iu*u - cm " s wM v * u i > oou ale 

to anouiot dCv 5CC OT CO >j KWSs \ U 'M^ v u ;« 

v\ <N s w v v wu programmed to s nd epor i central da ise on 
an tb ' o ^ v > ar I ' k o v o v s ' A ! 

25 ik>l 5 ^ U sS - ! o c< sw .an 5 v, si eh as. a 

> I v 1 , { ^ v. S U tic! t 

t v. f mU ^ „ ^ M ! v 5 5i < S « ! X M i > 5 i 

within the decoder to specify the conditions under which watermarked media objects 
d awKoun i ! v ! v muni a. I >&\ vh 

3 0 the toggett infoinsgtjon is transmitted to Mother computer. 
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t x. <.n -~ * ->-smd * v j -\ i > n » „ ! «n< S'iix ^ ! be >. (i * d ?i 

s > % WsO -v ' S' * i XtA Uk 

firewall aad ther oIk < ^ vjer-to-p s 1 <> > tioas thai encountei 
f ' r ! > m > !' n x n»< i c v. < s s r em 

internet Pn-wsem ukmfo h\ nc ( I ^ v v viK p.trt <. 

n\eotwi\n t ! <. m x ' »> ^ "^rnuui 

content sent in or as an attachment to e-mails sent between computers, 
Wafermw k Based Sliders 

Oner mn s, < > ^ b 

s < est * ' i s s 1 I > 

files on computer networks like the m O See U.S. Patent No. 5 ; S62,260, which ,\ 
hereby incorporated by reference. The software used to per form automated searching 
K v. u - i crawl < 

spider. 

As extension of the wa ten-nark based information retrieval, described in US 
Patent ~mo < 0 and marketed by Dig-mare Corporation, m ~ decoders can be 
employed in a distributed fashion to perform watermark screening and. counting of 

,< eu ! i u > 5 h ' ! > u i 

watermark decoder* ean be deployed at a variety oflocatforus on a cornpeter network 

he lot bx ng in Is eh or es that sort is < 

e i vie ^ v v. n «. > t s \ i t tl m 

\ ok <muk - do not 

typically rears, eeetent filters, etc. Each of dsese distributed decoders sens a>; a 

f ! n ^ hU 5 n i s> 

m ospo; ymeikm k c * i ss f$ include identifies 

«. x bom v k a h i m > > to 

addresses oi me fo atton oft .e m d - . , e t e am \ £ , were fomtdk rnd othet 
<. mimt i k r s v. i * t U.' The 

s v ! n m -a x i si i i ->t \i i*l c 

r o,ate^themf(»onatoo s s s 
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t ^ _J > , ( _ ^ ^ 

Vxaorn ! I w t Sshaiulu to 

seheduk progranuuahc events that occur in response to decoding a watermark message 
i i < 1 I k n S I < < v i i) \ si 

5 If (I S s v. ' \S , ! s " ! K 

message In some cas s, t > ctions made by software .m 

response to the watermark, while in other eases, these actions are device actions made 
<. m <. i o \ 1 <dw it 

U - >! ! < s s< i 1 v 

10 Rather than taking m actios', mmed te > rpon let iding t wait n 1 messagt 

an event scheduler can be used to schedule programmatic or device actions to occur at a 
later event, cither as a specified time according to a clock or timer, or o response to a 

<. i s s< Cl 

One example of this is to schedule a link to a web she to be activated at later, 
1,5 m 1 1 h i >n 

5 ow s < ope nans sj rem nu d'ia player or other software &pplk 
watermark from a media object that links the object to one or more web sites. In 
ses-ponse vO <: < > v < I 1 i s s <. > ai m .mi m 

occur at later imes. Some exa ! < 1 Is d s 0 a virsciow 

20 =. i , i I s ' . s v i s i < o < 'i m i atu 

1 >n \s i iap i ! , , This 

. j £ > " Or v s i l > m 

music or video track) or some product depicted in the media object. Using this 
opo !! a <. s v s t > s <. ! i ! v mi ol 

25 the watermark. 

Integrating a Watermark Encoder in Operating Systems and Other 
Applications 

to some applications, ft will be ascfal to encode a watermark or overlay one or 
3D mors ks to perform am > ! (e,g ie> 

hack to'cs, refresh usage rights, add links to additional information and actions, etc.}. 
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x i\ \ < e v { > $ s dd ba t eraling system. Interne 

browser, or other applications. For instance, through a drag and drop procedure, a user 
f embed a «. s h sen oh t « of enab tha s 

5 As mm® kample, a watermark coco les m< > b< h fegrated in a Ok browser, 

Internet browser, media player, or other application nsmgrhe same integration 
techmoaes outlined above for the decoder Fig. I for example, shows watermark 
encoder ) s integrated into the Windows Explorer Ok browser via a lot 
extension. In particular, the watermark encoder is implemented as a shod extension 
handler Fhi < cs >v tsteud as .o;n.^:!o.cwo 

Window is (ku* m \ c V > ' v. a s < moo^rin^ 

pa v .a? on handier 

I o s. ! v j t ; \ unp< i < i . 1 

a media object nd ot 5 the cot) x , hod i { ht 

espoi i di 1 * wn in Fi s window « ahles 

> v. s I s i < s > * i ed into an 

rm>K.c \ m a rvmmm a! 11.-. uw tn.; - \ . w\ it- ... < t\ < -o -b;ei t 

he user c he woK\ j-t? lurabibty of th 

watermark b -rough a scroll bar control The user can compare the original arid 
nfs s .odm t ) rod "Watoicufs 

tabs Y\rw - ^ ; n i <. 

S sj ! ! i. * I I 5 j < v 5 

object by forwarding them to the metadata server, which associates them with an object 
ID. 

t s. v\ 5 \ ! w ! oh *sn >o < > i 

wd m emfwafow - ^ u>jd>i;..a a . < a, o s I j s h hje 

o . t i Kv. % ^ u r m jX, hi, 

deigned to launch a media player to play the marked and unmarked objects as desired 
Digital Watermarks as a Gateway and Control Mechanism 

The Internet presents security challenges to corporations and others who hav,: 
s i Ks a torn N n ieonn, coo t nt nl >- t\m * oS w si 
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networks. Traditionally, documents containing confidential information are marked 

A tu^* v s ■! % i vo\nto s u \i \ 

"PRO^Rirt \ v\ v< ,uo\v,ii a 

documents foetth v. ^i; <. < v. f ^ >o 

5 special preeu shoes ft is r.UluK ddTkrdt and unusual to; someone to manual!) send 
such a document inadvertently to an unauthorized receiver. However, the use of 

s i l 1 O i l x OS 

makes mahoious and inadvertent transfer trivia;. 

I he f.ot< met, electronic mail and other network fife transfer protocols (k IP, 
10 HTTP, etc.) simplify ( eed t! < «« < > > > >tocols also make 

it much easier tor someone to inadvertently or accidentally send a eon hderPlai 
document to 5 > 

Hu »ca o < u i <s i b n u 

wa termarks to control dse transmission and/or receipt of documents transmitted over 
15 computr vorks su i ystem 1 > N u 

prevent the accidental dissemination of information to unauthorized receivers. 
Furthermore, s f 1 sten help 

< t > > s x t U v si \?o t » m 

unauthorized receivers, 
20 N x ranv.nited messages com ur tes. > v 4 5 

•> i ^ ^ i si o j * i <> o h x <. i t > \i i 1 ! 

and fojm p > « m ^ \ > , m\- 1 m i «. > ' i - , 5 vt 

! i n ! <"»*veii moil m s nm>e ^ m! 

"confideutia! . An image or sound clip tea; tonus pan of an electronic message can 
25 < v ttc : > . ^ eeted and rea term idin 

! v s M > ! i ! f f 1 i ) 

o; mm o u\c cbemceis or inns according to a hidden pat& m that does not change the 

f a % s i i ! x < ! i i i 

modulating a binary message with a FN sequence. Such a pattern may be used to add 
30 orren . of Hues and para edp fern Alternatively, 
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K d ) w'i ' i i o 5 v <k 0 > s < 0 

according to watermark pattern. 

n o i <. s r ^ ev <. 

S v \ Oi K > I v ! v i 

5 Si ^ I 1i 5ft - ! > < f > > 

< ! v 1 < ! ! <! 'I v v s 

particular manner. 

Typically, e-mail enters a transmission network by way of as e-mail server. 

IS " n 'Kl \ !ttl vlii 

10 vtt^ii < > v > f j i * <> l * ^ 1 !> V I S S K f I 

tmssage through a watermark detection and reading program prior to sending the 

i < < i inetwi: k. if Use w.Uen * uieno. v s k 

nt*.rroa tkv . v. \ i <>m. f ee\-fios!,' e> n.<- ! i < W h n 1 J 0 'It. 

watermark reading po r.a as sp.sro - - \ei . c .- take action such as 

I S i ti n !■ <. ! . o I ' \ s n trogi an finds 

!< i a s | s f \ i ! > i f oxes tl 

n N ! is i 

II ,M «l UCiltl K\l 0 5 » 5 s J 

and receipt u 1 < v. messages 
20 Messages and documents ? enter the fmernei and other electronic networks 

... \v < \ 5^ l > - v" t * V " i j v - 5 J! < <> < 

v > v i K - - lv ! ) v t s j \\ b if (< 

P xc set u> sounding rro i? ten > I >! it 

Itogm vP S I O vv Vd \il i ws.,, U> t VSvt lk\i'! 

2S oen.< s\cf ska dec w.;i ic— \n e ' '\:oc rm I < web sole 

I nas t f i - ils u i } 

\ v. o i > < - hj.i >,ii'r 

or HTTP requests . 

A first embodiment of the \ * > >-j designed r •• o v < ) j ^ ■. > s 
3d ra mat I m i m is used t pre > the ac id 

s a of condaenda; e-onad messages to * i cscto. The drst 



» s > N v nt ni I ■! ,. youe \!h a « 

»>k. i > s conhol the ! s , \ < m , v t' documents to unauthorized users 
o, V ii - , ; ; - c. - O! ; ■ ,i i >, , . ni e me i 

t ess; !*e S i I n des s 0 

5 i t - ml realising that on© oftli addressee is not 

oiizcd to .receive cord m s est - prevent sue! h 

from being >n i to the f i . 1 person even though the sender included the 
addrs s of t i pes ?o > so ? 

\ npu - a \< c x > u x i lu t< v» — hww.wvi 

10 10 can either he an e-mail message, or alternatively it may be a document that is 

attached to as < 1 , { > S 

i s i t. Theconfid niialitv tamp 1 1 <; word 

t s op ' 5 , i > t > the 

background in smage 1 1 has fines of a the width of which are varied to carry a 
1 5 watermark m accordance Mt the teachings of US application 09/074,034 , fifed May 6, 
1 s ! ( 1 1 1 N k ! f s apph citron 

09/127,503, filed July 31, 1998 (which corresponding to PCX application 

i ~) the u^dov r. r, » pin io^ u 

herebv mcoreo t e <v . «. ui l> > ■> ui >. . s <> mh t 

20 h o ; ! it 

Cfi uC"! 3 d 

•one U spcua t i v i v j t 

r h i i v s 1 j e lac is m< the? 

} * % s ^ v. < n t m-Vi t a ') tin ii j i 

.25 ^ s i v > ^ v ? i ! I < v i it i i dt n\ «( 

^ v. \v t it e w ttu i ii I t 

! i hmnu' ,c> *on 
C nfidenttaP nnluui i - m id mt can he i d hy u wa?cn rk detection and 
reading program. 

30 fhe data fields ami flags hi a typk sad are ows Of xs^ 5 

It should he understood that the fields and flags shown are merely representam e yid 
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They can take many alternative forms. The system utilizes one of the flag fields to 
indicate en > s > » s t 

coiwentional manner. 

Ftg, 10 shows a.;. e-mail system ! ' v. s k detecting ^ reading roatmes 
5 .for monitoring and i < i ual use 

terming SOU to 330 k ne connected to an < sail sen r 1302 Such connections can 
*x 0s an f a v v < v v s s > 

computer network connection. The e-mail server 1 302 has an interface 1 303 to the 
fotem I 1304 and i , m I 

10 rn h » 1 i u \ ! s nnmat 

mterfasrc to v i < ) s » 

server. With the present invention, before the e-mail server 1302 transmits a message 
from one of the individual riser Terminals 1 301a to 1301 etc the internet, the e-mail 
server passes the message through a watermtok detection and .reading program 1305. 

13 10 e s. . 0 v >t, v ! r; ;t , 1 

program The watermark detection and reading program 1305 determines 0 < message 
trl »k i h < h tnt -> 

ei J II n > t \ t to < it iOv. * f s I ! si ills tit 

message to the sender. Thus ; the first embodiment paduhils any confidential 
20 information from being transmitted as pari of an e-mail message, 
i u embodiment p 0 mat 
s ^ ! s n 1 < s nu ha* 

a bu o> dumi gmma o^ p-se^e, : : r.i - tee -<.nd r.O^S'OMnv hhgasm pomp s m 
\ v v 5 v v , v sc ^ t ^ i i v. 1 < V > , u 

2e t t i; ! j i < i a I 

v : . g ^;e,Nf \: ii\r\' U i viiM s > w t << 

1 . p p m\1 F3 sc. J < - > t > M < Mt* t < 

mpler e U i e 1 > u'o >Mpglebe 
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administrator 


SI 


R2 


001 


Send naasssge. s log fed - t SI 
i ssaox R2 


S1 


R2 


101 


Pen - ; ^ wr 


S2 


R1 


011 




S2 


R3 


110 


Do ■-)% v : -i nessaje ^d *k-MV the 
system smnnmsUvaaor 



The §> stem - . s s 

server in a FiRST-IN, FIRST OUT fashion. This buffer may store the messages 
i i > I * > > ^ v < ' v > e A 

S watermark readme program 1 404 reads the message and/or attachments, attempts to 
. ^ < durk ' watermark o- e nKeVe \ ■> , 

Vi>\ p f v. * * ^ ") 

U'^ x ,i\i>'<'. \ ru.' if 5 s ^ ^ v e logte t\r Mvjs *ho 

sender and recipient addresses and maps s < to previously assigned groupings, U< 
10 ! i ' Oi i f t i 1 1 o n > t p; s *n 

P 1 j ! v vnu-eiptem codes to 

s < *\ •> m*. v t<=m ^rkK 

• ■> < m 1 loo that 

i f t > si ; i t i i * t. 

15 buffer 1403. 

a sun»aar> « < recipient 

v ^ <. ^e < "ta n < ! ! I s n 

< o ie i < alternatives m win to t \ < i f „ f n, „ < 

l < i K ^ O xn ! ^ v 1 i t > ( f 

20 «.ht ! > s > 

"confidential". Such a system would allow confidential documents to be sent only to 
selects ! Utermitiveiyor in ddition, the system could xdude lis 



oKkviduah. authorized to send confidential ^ ^ The system could merely check 
the sender agamsi this list or aUernafo-dy, the systems could recmrre that a password be 
i ! tered 

it should be noted, that the above table gives only representative rules* Iivaa 
s i sere c > ! > ore groups and some sa < I a single 

* ! it-th I < s > s. em s. boo- 00>1 ^o\o -Inns 

only three flag bits. \ syst< u v ( i e 1 > axis of the 

particular system require. 

i v h!o; Ox os t icons % , > moo a o.xuanark 
m an image by means other than using hne width or halftone dot modulation as 

O s t <. i i I i | ■) 

digital watennsrk. 

In an a sarive c > nb t c t eking for a digital watermark, the 
s> 1 n co o c tet 1 ext string men. a i or I xl take ctiot in espouse 
to it) such i text string. Also, the system could check for a hidden si < > » ? <. 
pattern of spaces at the end of the lines or paragraphs. 

\ p •> , <■■ is pn i ^ j h 

prei unions ;oub be inks wit FIT sen s j wit W< servers 

Content Flliorlng and Indexing System Using Digital Watermarks 

1 i diagram dlustratb % 

system, ad ! > s such as 

s % i n •! ! i ! . ! ■> , ■> ? I 

urmeuo;mmc the eomeoi v.ben rendered to end- users so g., ponied, displayed, 
f. a eel ic fins * c s I \ \ if >ax 

. ' t n is ode ■> I he 

embedder, referred to as a watermark content marker 1 502, 1504 is incorporated into 
content sorvets, such as web su\ r - 1 s < * - M" -* f\ , < .s i ^ ' .. 

bn> t V TdiiTOxu'on i th <w % ^ % enmods 

mti nark} ytoads repeatedly «* oegoom . u, s iporal oi 

, , peteo v, o;ur> the same et duiers.ru, rsasfoo . ^ m ^ l ,Ji it is 
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>added * 5 ! ) s $ i s c v \ < ! langes 

U < ! I t 5 <v < v 2 5 \ 

<. i (>>y si Ci 

This content is then sent via a communications network 13 10 to other systems, 
5 such as web browsers 1512, email readers 1514, media players, etc. Along the 
communication path, the content may pays through a firewall 1516 and L AN i S 1 8 . 
in < ,,'\s ■> ^\ no r>a ^ ' v- s \ 1 o " v. d, i ! ^gg 

i < i v j \ "\ ! < K 1 v \ ^0 

paybad of these watermarks T he message paytoad includes information about the 
10 content owner (owner ID}, distributor * s n»\>t IDs. n i > transaction c n d m 
n i , t i M ' 1 x < j i v > 11 x In 

addition, the payioad includes content flags thai indicate content type, such as adult 
content ratings, limited access ratings, en;;, 

The watermark content, fibers liter content by controlling its transfer or 
15 en If < )l i hixi PX and 

? i O < f }.«»>> ui(ti 

11 i < ! > v astern logs i d v ion that i 

demeuKf o 4 vi i , i i ;vl , - < Ik stents 

v. ^ i v s ^ < • d , i ' i,- yscr 

20 is , i < «. i ^ v. i k s t i < nu 

v U 1 O i b|' u i 111) 

tiles- v^i^ c i ri, n»ioi ; f 

o \ rn- n t It ^ < > site » n< so to 

example. 

25 The content filters tor web browsers., email readers and media players prevent 

o.l c v s I neni fl bits ! 

a -wit i i v. 1 > - I -k h 1 i > b 

to bloeks ndormg of adult eonk , > 1 ; these rales are 

activated, when a user logs onto the application, up a i < I ixxheatrng to the 
30 filter that a particular user is using the application and certain, rules applicable to Chat 
user I'D are activated. 



A m niat approa b ea ! ?k us<. \ o fihc a crtiMm irons co uent fot uses 5 that 
have paid higher subscription fees for content. In tins case, contest including 
advertising flags is detected via the watermark and removed before rendering, 
•-inn! j k<. v ei v > 

S i n v. a i\ ' <■ fl 

n flags < s s < m b > 1 s N k 

I It!! i 0 i 1 N ! i > ! IN 1 * i 

vOi* U ! j ! f * 

users may receive content from many different peer -computers-; 
10 ! uehuole database 

searchable index of content -fivMi.' computer addresses t URLs or IP addresses) 

where copies of th cordons, can h found \s such the system can be nsed to create a 
, i ! ! e In ten > enabl rs to > the database bp 

<mtmt ty$% content ID, distributor, or cthei oh Urnked < n ID nm 
15 find content items and their corresponding addresses, 

! ! v. S v. ! Li tin > 

\s vn v v v t - ]»!( < t d 

spider thread programs that screen content for watermarks, and when found, report 

! v i i ' ! f v i - i ! S i < t < ' v 

20 k V v ' S ! 1 i ( V ' > ! < 

1610 executing on server attached to the internet 1612. The thread programs are 
iniplemented m internal systems 1502, such as content databases on company's LANs, 

\ V % ' i U - t I N < ^ i < > 

> s - \ Cg n , , e ; , ^ 1 U MlMM 

25 xv vt i I i < « < >t 

The | u' program i 610 scores the watermark pay load and event information 
jo s auV. "'id' lr\vp< v ■> ! <. i i n ■> f i 

comptkd uvm*at s ik cekchoncv is to add ttmnai databases dun ; oeiak 

CO rt iD- tO v v .v e i v ! > i i > M i * I 

30 U >nu- t 5 - j« v v v n % < UR i <. v v * t This 

v nabh-r uv.ns t > as cess the spider program, ovaah to cook-it h en-o an raV or some 
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oilier aUnbaux and then cross referents to network addresses where the content cao be 
found, 

bis -sss? E j i \ ^ v S V l ■> 

iCP k * ; v o «. k > -v * <. . o o ? iN 

S r 5 >h «. iked i t v a e s ) \ se ! s 

e v\>i < <\ ^\ u vn\e m stems, 

VHO (. 5 ' s ^ X lu 1 k 

d ta 2 l vv\<* t s vi x n o* 

tO < <. <. <. i oof*. u*< v 

computer or other device, such as mus:c appliance, set top box, wireless phone, etc. 

There are i ntnuH p n v» d o:-^ eavnvrn* i k S <> the 

distributed content filtering and spidering systems described above. When filtering 
content based on the watermark, the watermark payioad can include content type Sags 
15 or an index to content type descriptors stored in a database, in the latter case, the 
system queries the descriptor database to determine the descriptors that define the 
lata ! t t. Bit e t s descriptors can be use trcl 

m i < ! eh\ti < , % )> i 

n ^ i > s s w - Co * > nsn\!< * - s - ' i m M 

20 i > t e | > > n v u s - f j 

s > «, < k .fiorsv 

content descriptors indexed by the payioad to create a uk» v < < i th cmneot 
by Its type. Users can then search this index to find content matching content type 
v s ; 5 ! m > i s t ) i < ah nn f J Siv s 

25 It. us -nl u.'i ! „ ? <■ t < u -pk h - 

v. ilennark filter i no pi -vein p.Uy as t con - ru n it m, pi tybaelf Qi t« 
scramble an objectionable portion based on the content type Hags or descriptors. Since 
■uufiu ^ Jw, \ vi 1 M f v. t * i s ae >>n ' tjuo 

-> i I ot Oof over whu i > *K i > v! 

30 which portions of a md an v get blocked. In addition, the tiller can seioeO ! -e;\ 
control u <. type of content that gets rendesred, to* example by sn* a ping in fra so 
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if< i tk-n t v I ot e - i i s t 

i i s<, the In 05 ee ^ < < !\c.^;oiv,t.>.:> 
meehaaism can stream alternative frames ijj response to the filter's control signals. 

i l x O s v 0 \ O > v 5 

! i i ll I < ' » i s \ s at 

) pa < ' v s ^ id inch derskfie; 

l i < S i l 1 v < ! l ! i s > 

loweves -acalh update the da ib v es y to 

spechy ;i new machos behavior for she identifier, such as a new URL, specs he to she 
owner's web site. 

Operating Environment for Computer implementations 

environment for software implementations of the watermarking systems described 

■> 1 s v. ! *<i ii S V t <. Ifv 

a - * o* ou 

v s s s i !. i pi 5v I "2 kdf s v 

processing unit 122 k a system memory 1222, and a system bos 1223 that interconnects 
v a o \ is s i i 1 i i t ^ 

n system b t may comprise rrvoi sverai types of bu tare in i eg > 

ilM .-O 0>l\, ^ v! > 1 < < - 

, <, ! s V 1 s \ v " ^ v. 1 S i ! t 5 ^ 

Ihe svs j ; i i ' cat r aalora 

. ,a .mi s UM ' \ > , < > ^ -< , < i > << > , he 

. t si i be co \ pa*cr 
s v daring start- >red in ROM '12 

The v mn v t - t i ) i e i > < < is - 

2 8 s i i « i v el re o\ I s< 229 t d at rticaf d 1 
drive 1230, eg., for reading a CD-ROM or DVD disk 1 23 ! or to read from or write to 

other optic; onJLs Ta< bard diss- " ' 1 s md sptiea 

disl ve!23 area eon he s^ \ s i hbya %t4 sk drive. intes xct 



1 l-U *KJ M v. v > " v e i s " \ 

f „ * T , ! u„ ; ^ v l ! > 5 Ov 

nonvolatile storage of data, data structures, computer-executable instructions (program 
cods such is dynamic link i % > m ( ic corm 

5 AHhc . > d > > < f compute - v t t ovc refe rs to a hard 

is 1 < < k v ' < v i SO ! v ! \ " \ -t 

i ( i ! ! 1 ! i v v. v Of id 

Ji * t 1 ^ id1v\U 

A number of prog-am modules may be stored in the drives and RAM 1225, 
10 lit i st 235, o«e or mem application 1 ms !23( othet 

I i > - 2-" u1ia„ ' s uk 1238, 

A user may enter command » mormatio v -> - < ndta 1 22 

s »ss | i i s i % K -! j, f unnn 

s ! , ii , 5 " < - S H S 

1 5 pad, satellite dish, digital camera, scanner, or the like A digital camera or scanner 43 
> > , > < ; - v ? < t t i n The 

cam s c d * ca s m tcrfece 4 

i t < i v S ! -si 5 ^ i h 

i M<i 1 t i ( < . o av co 1 so ;o h H t t oa: •. ^ < n k 1 so 

20 s ! v _ \ o <. 5 s ^ n > u d 

. oov> o as 1 wm 1 iLkik). 

In \1 ht << to a camera or scanner, watermarked mwges or video maybe 

s s I - i s 1 5 , X i v t, i ! < ! u 

i i ' i a a o > > t e\ 

25 \ * « i> < f 
- sad a a ;o an-;. nd ea 1 et 

o v> >x.s. a / mien cw\< atee! 1 the i - a .~~o 

thtot <->h •> t; t s 2 h s v t i tho 

v v s t 3 5 cos hii >< port, parai it \e port Oi 
30 % dsc b;n; < SB 



V 5 ! i \ r ^ ' < * o - s-J to s 

bus 1223 via an interface, such as a video adapter 1248.. In addition to the monitor, 
persona! computers typjcally inchaie other penphftfa; ontpnt devices (not shows), such 
; - as > o < i 

5 - ~ i t - v-'H 1 ^ ! i 

onnecbon sneo note compute < 49, Th 

remote computer ! 249 may be a sen i < c N 

5 N U I i *' ■.v. ( 

i e < > N N i > s s -a > j o i! M t!u' hi 

10 s <u ! v i s > k > ! e vori 

s I a,\> H s <. r ^ x \ n i 

S £ i i P i ; ^ t 1 ! i 

en us s\ < ) ter I no? s 

to the local network 1251 through a network interface or adapter 1253. When used in a 
15 \ a i he person ^ ! is 

S i<x * ! U >t s ! CCC u ), V 5 it SK.i 

s «. % ~. t 1 x s. t d 

rt v S ' n % i i 

% \ ! < < 1 | ; s i v i v n 1 

20 f 5 s » o s > 

s s i >. r ed < ak> taktoon and 

as paradel processes, it wiO be appreciated that the network connections shown are 

en<p onurunaa'ann 1 s 

computers rnny On \c J 
25 Extensions to Other Forms of Media Object Uniting 

i !V OKI* S l * J } V ij \ \ i K i !>J O i i 

v.* 0- \ <. £ \ i v f v>t iU t 

f o s v 5 > ll» isscila^v n < * 

data structures other than a wateonark embedded m the object. For example, the object 
30 iden ? v o \ 0 >< > <■ i ■■■ s > d 5 om h 

else in the m obi-.x « is a die he s ^ * lemifier may be i serf d 
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iiV'i ! ' ^ i * w 1 > ^ ^ v N i ^ <.<.Ior pa*\es 

C e %< ^ *• s s Mi * i 

toatiucil u v v< s ■* v i> ^ N s <« * . "i > O ! < ! v ^ ^, ^H 1 
hi 'U^C si i ' ' > \ i Kt eoda 

5 ut on o ; :e , o, , , u- 



Concluding Remarks 

^ i k. \ v « ^ ' s t v f i \ o ^ 

10 to specific implementations, it wiH be recognized that the technology can be 

SO ^ S < H 1 ! < ! > 

(stents and ; | t fcrcne 

] 1 i K V ) , V. I i V 1 

15 vj i < < I I S 

! s Oeme p<ne^n *g 

a>^ icetemoi > oi 

) ! h <. < ik\ th 

!!^o-!vwr'!i;\ ;-pK ; , i „ -e- ;! o s o ; >-«' K - jto 

20 v v i > s < j t f 

we a i as <m? invcBtioa all such < n J i as may come within the scope and 
^\T!{<ff'j\ sehoo „,r \- e 0 c> e> eo hesem 
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We Claim: 

i . A iife browser system comprising: 

s f x , t tetit.cc a mp-Jw^ ! on o 

5 lliea stored in memory; 

a file browser extension tor decoding as object identifier horn a selected no 5 3 

-\ ! >' s H~ C . K i > \ ! ^> t, * U v < V \ * v Od 0< 5 !KA',>'.'1 

w vi> < I > i > s o ok v Hitler, 

10 1 IKtl I v s i i ' \ 4 m'k .Ktl 

msm i w a tt.tr -o ; , a object file. 

3. The file browser system of claim 1 wherein the file browser extension 
displays the metadata o I «. 

1 5 ilk browser. 

4. The file browser system of claim .1 wherein the file browser displays the 

1 5 O \ '! > I v 5 n< *>< 5 !! <\ < v v t b d t>H « 

20 5. Uou; K; ^ ^ sees \ eh , ; \^-ro. \ Jo. <, no>e .-o c\km\km 

n turned fros t the serve 

6. s - ^ st * ! s , i i s O k l u 

25 «. S > * v s it lit! ! 5 5 ( ft < ! , 1 

from the metadata server 



30 



?. The file browser of claim 1 wherein the metadata > actios is displayed as a 
ii,i ^iii-s. pi) ii tw t ? * t fib 
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8, A file brow f - s 

a .file browser for displaying t a user interface media object tiles stored ill 
n - << - an I 

a file browser extension for encoding ao object identifier into a selected media 
5 ct file and for displays* > > v. v ■> e 

v > d i f a i v v a ^ | ! in K 



9. Tbe method clean S wherein the file browser extension comprises a 
svcuejm s 1 i ! a f v <. t < ! \< , 

m 

lib A. was rn ah <k xk systs np> 

hi - iog a use; s ii< r ice rbs ds >ph ; gas eseniaiion of 

media object files; and 

an extension to the host application for decoding a watermark from a selected 
! 5 n$ k \ a < e xiat n 

action associated with the media object file via the watermark. 

11. % ; e v > u ore < s v > n v a i K > w vl 
eo ^ >s >w 

20 t fki |K«' S s. v < 1 ^ ill Ut, aild 

w ? ■- n w i u ! v <! W \ v ! ^ > > > tvO 

from the media object; 

\ - i I ! s . o - d s Kf 5 v n m t i I d 

n [ eennu n response to user input 

25 

12 <■ > o the object d? I ( 

noes s waicrm eh embedded m ha; media object 



11 - ink m 5 wherein U metadata & retrieved fi n < 

30 , t of b;, s w the object identifier to the metadata server 



-48- 

14, ImetmdoixCm^ n v. i o „ ? \ 
leco* g an object den > b« i d io y ct 
>v > m^ m n ' » s t ? \m xs\t', 
receiving a brand identities from the metadata server; and 

5 m \ 

15. the *mn < > £ is! x v o 
watermark embedded ;n the media object- 

and the representation of t.be brand identifier is a graphic superimposed on a -.rendering 
of the video or image. 

17. i 1 i t v.? 

IS m action associated with the media object, 

18. f e ne\a of 
tin don from a note server. 

20 19 <\ o hov lie ma ot < n <. m t 

' < pa ^ >> So i s v. > u hp< t 

«. « object; 

v < iv i > p v he n U < n 

d 5 f ! i > 1" Hi 

25 , < , object 

20. k n i ■» m v < < s i t v x< 

i s s 1 s v. wa mrk erohedds he s j 

30 > * ! v s system aicind m i k inch sends d 

mcc-ves messages, said mat! se-ver mu d m a reading program winch mads 
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;tas ujograf hk data hidden in aid me :>s m I which controls; di anbudon of said 
messages in response ;e data m said data. 

22, A system whic wiudes an e-m3 v< < » $t« 

5 means tor transmitting messages from individual user to said e-mail server, 

! \ s i s i s v v i n ks s« ^ n 

sessages efore such m -< aen ae i milted I nn said ; el serve to the Imerael 
if ! s d i s i v « " 

he Internet if said watermark detecting means detect 
Hi Jdi f lessage Kiudau > de? 

23, i im 1 hk 

<. < i i 5 x x ! 3 1 On 

including a digital watermark carrying data that sadscatcs that the message is 
15 v ! i ) s i u n ana 

\ i ? t j reading program winch reads waternnnts in messages arid controls the 
distnbtftnm ->1 -i s -na\ <uo\ 'i! un ^dan^e with d , .uowtii.o.N ac\ w.sJtmtnuks m 
the messages, 

20 24, \ s n o » i ' . - a< .a J v s v t '. - iit wJude 

^ i > ' i i a > ik i 'i 

»di dnC dv, ;;;.-,aa.v s ■ i < e: d a* 3 i 

i v ^ "'iv 3 k * a»<v 33 M 3 <H 

u> , roh ^ , ! i ' i .s i - 

25 > i < < < v i k i i 

25 \ method oftiamtmt ,3 } v. « ?et,es\t. 

wbxc i comprises, 

detecting and reading digital watermarks -embedded in such messages to 
30 deten ehov * ig v&iern s are i 



-50- 



i rig a database ! n<- s\ - k ; s ( 

v ! ) s i i lame y oi receive! and the flag 

! > «. rk ie.rnesx.agt 

5 > \ vc^ic ' i > \ ) t n h^uhmed 

in programs executing on computer',; mtercaonected vus a comrsurnicaisons network, the 
w; : aerr;nok contemn filters being operable to delect digital w-atennarke in content 

m j i i ^ <• en ( >m 

i o tuli i < x v ^ ^ ^ 

10 ^.a no 



27. Tne ^ 

o t earchable databas* >a'b i 1 * ? to c; c t for cos t as HI « r network ddress 
i \ a n s where the content has been detected by the content filters:. 

IS 

2.8. Wv > 1 i ! i s ! t >! 

< i v e ! ! I v < ! > fl < Ji * n 

watermarks. 



20 29. c •. i Kiv i- ii i). tiK hi. 

akrng with r<;w j 



30 Ads -a v. pricing: 

25 pt&l watermark d } spider thread prog? * \ 

X v s 1 t \, ( M 1 ! ( S 

to. screen e< sr v run x t 

rmatioo van k| no the Yvatem n»i - in o 

ttlie vuj 1 d eso . ^ 1 s s v o t i <\ 



30 
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31. The system of claim 30 wherein the information about the event includes < 
contest. 

5 !J 1 s^ 1 . 1 it* %! ■. " v < 

S ( 0 v S I s t \ s x v * n U < v 1 

» ' t' * 11 ! i \ i v. < v , vtl M' 

v^nk t » ii i v nO >k >. i v. v i i ^ 

and iinO ~uaU?o ^ >. 

1 0 information can be fetched vis the system. 
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